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±^ Abstract 

S We consider the problem of customer equilibrium strategies in an M/M/1 queue under 

dynamic service control. The service rate switches between a low and a high value depending 
on system congestion. Arriving customers do not observe the system state at the moment of 
arrival. We show that due to service rate variation, the customer equilibrium strategy is not 
generally unique, and derive an upper bound on the number of possible equilibria. For the 
problem of social welfare optimization, we numerically analyze the relationship between the 
optimal arrival rate, which maximizes the overall welfare of the customers, and the cquilib- 
^-H rium ones as a function of various parameter values. We finally derive analytic solutions for 

the special case where the service rate switch occurs when the queue ceases to be empty. 
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1 Introduction 



Service rate control is a prevalent tool for dynamically adjusting the operation of a queueing 
system in response to varying congestion levels. Many models in the queueing and service 
management literature, such as dynamic staffing policies, server vacation mechanisms, etc. can 
be viewed as different aspects of varying the rate at which service is provided at different times. 
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In most cases, the philosophy of a service control policy is to increase the service capacity when 
the congestion level is high in order to alleviate excessive delays, and reduce it at times of 
decreased congestion in order to lower operating costs. Viewed in this way, a service control 
policy provides a balance in the tradeoff between long customer delays and high service costs. 
However, in situations where customers are sensitive to delay and make individual decisions 
about entering the queue, the policy used by the service provider may also have an indirect, 
albeit significant, effect on the arrival stream. 

In service systems with strategic customer behavior, incoming customers decide independently 
whether to join the system or balk, based on an individual utility function that combines the 
value of obtaining the service with the cost induced by the anticipated delay in the queue. Since 

a customer's delay depends on the decisions of other customers, a game-theoretic approach is 
appropriate for characterizing customer behavior and thus the properties of the incoming stream, 
as the result of an equilibrium strategy. Because customers arc averse to delay, it is expected 
that a particular customer's decision to enter the system is adversely affected as other customers 
also decide to enter and system congestion is increased. In economic terms, entering customers 
induce negative externalities, by imposing increased delays to present and/or future arrivals. 
Such situations, where in equilibrium a customer's willingness to join is a decreasing function 
of the arrival rate, are referred to as Avoid the Crowd (ATC). On the other hand, in a system 
where a form of dynamic service control is implemented, the service rate is usually increased 
when the system is congested. Thus, it may happen that if a customer decides to enter the 
system, the other customers experience a benefit, because the service provider is induced to 
increase the service rate. Then, the net effect between the additional delay due to increased 
arrivals and the higher service speed due to the server's policy may be positive. In such cases 
where an arriving customer induces positive externalities, the equilibrium is Follow the Crowd 
(FTC). Both the ATC or FTC effects may appear in the same system for different values of the 
arrival rate. However in most situations, the presence of FTC is related to a dynamic service 
policy employed by the service provider. 

In this paper we analyze the customer equilibrium behavior in a single server Markovian queue 
under a simple threshold-based service rate policy. Specifically, the service rate is kept at a 
low value when the number of customers in the system is at or below a threshold level T, and 
turns to a high value when the system congestion is above T. We analyze the unobservable 
case where arriving customers are aware of the service policy, but do not have any information 
on the queue length upon arrival. The most pronounced effect of the service control policy is 
that, in contrast to the simple M/M/1 queue in strategic equilibrium, the equilibrium customer 
strategy is not generally unique. For example, one equilibrium strategy may be such that a 
small fraction of incoming customers joins the system and as a result the server works at slow 
rate for most of the time, whereas there exists another equilibrium where the arrival rate is high 
and the server spends most time at the fast mode. We show that, depending on the values of 
the various parameters, the number of strategic equilibria may vary from one to at most three. 
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We also consider the problem of determining the optimal arrival rate in a system with centrally 
control arrivals which, for the given service policy, maximizes the expected net benefit of all 
customers, and compare the optimal arrival rates to those obtained as equilibria under selfish 
customer behavior. 

The implications of strategic customer behavior on the performance of a queueing system has 



been studied extensively in the recent years. Early works on the M/M/1 queue include Naor 



(1969) and Edelson Sz Hildebrand (1975) for the observable and unobservable models, respec- 



tively. Many variations of the original models have been studied since, and a comprehensive 



review of the literature until 2003 is provided in Hassin Sz Haviv (2003). Among the models 



that have been developed and analyzed, many include some varying service rate characteristics 
indirectly. For example, the capacity choice problem can be viewed as long-term service rate 



decision. Stenbacka & Tombak ( 1995 ) consider an unobservable system with nonhomogeneous 



customer delay costs and service rate decisions made by the firm. Chen & Frank (2004) analyze 



the joint impact of a firm's service and pricing policy on customer equilibrium. 

In observable models, where customers obtain full or partial information on system congestion or 
anticipated delay, a varying service rate policy may have analogous effects. |Armony fc Maglaras 



( 2004 ) analyze the impact of announcing anticipated delays and providing a call back option on 



customer joining behavior, in a call center with two service modes. Debo & Veeraraghavan ( 2009 ) 



consider a situation where the service rate is related to the quality of service, it is unknown to 
arriving customers but can be estimated by observing the queue length. It is shown that when 
the service rate and the quality of service are negatively correlated, customers join longer queues, 
which is not the case under positive correlation. 

Other systems with a varying service rate feature include vacation queues and systems in a 



random environment. Burnetas & Economou (2007) consider a system with server vacations 



and reactivation that requires a random setup time. In the vacation model of Guo & Hassin 



( 2011 ), the server resumes service after a fixed number of arrivals according to a threshold service 



policy. Both papers analyze equilibrium behavior with respect to several levels of information 



about the queue length and the state of the server. Economou Sz Manou (2011 ) analyze customer 



equilibrium strategies in a stochastic clearing system where the exogenous customer arrival rate 
and the arrival rate of the system clearing server vary according to an external environment 
process. 

In the area of queueing control and optimization under a single decision maker, problems of 
service rate control have been studied extensively and in many forms. It is worth noting that 
the problem of social welfare maximization can be formulated as a static or dynamic admission 



control problem. George & Harrison (2001) consider welfare optimization in an M/M/1 system 
with dynamic service control and constant arrival rate. They develop an asymptotic method for 



computing the optimal policy under average cost minimization. Ata & Shneorson ( 2006 ) propose 



a model that jointly optimizes arrival and service rates, and develop a dynamic pricing strategy 
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that induces the optimal arrival and service rates. [Adusumilli &: Hasenbein (2010) consider a 
model of joint admission and service control in an M/M/1 under an average cost criterion and 
show that the optimal service rates are increasing with system congestion. Dimitrakopoulos & 



Burnetas (2011 ) analyze the effect of service rate flexibility on the admission control policy and 



the service provider's profit and derive a condition for the service flexibility to be beneficial. 

The present paper proposes a direct model of the impact of dynamic service control on customer 
equilibrium strategies. The service rate is dynamically adjusted with state congestion. Under 
this situation, the delay function is not monotone increasing in the arrival rate, which implies that 
for certain ranges of the arrival rate, joining customers impose positive externalities. Another 
consequence is that in general there exist more than one strategic equilibria, however we show 
that their number is at most three. We also consider the social welfare optimization problem and 
the relationship between the equilibrium and optimal arrival rates. We show via computational 
experiments that optimal arrival rate lies between the extreme values under equilibrium, due to 
the existence of both negative and positive externalities. 

The rest of the paper is organized as follows. In Section [2] we introduce the model and the 
corresponding customer strategic behavior problem. We also derive the expected delay as a 
function of the arrival rate. In Section [3] we consider the equilibrium strategies and derive the 
upper bound on the number of equilibria for general T-threshold dynamic service policies. In 
Section [4] we explore numerically the socially optimal strategy and the comparison with the 
equilibrium problem. In Section [5} we derive analytic solutions for both problems in the special 
case where the service threshold T = 1, i.e., the service rate switches to the fast mode when the 
queue is not empty. Section [6] concludes. 



2 Model Description 

We consider a single server Markovian queue under the FCFS discipline, where potential cus- 
tomers arrive according to a Poisson process with rate A. The service rate is dynamically set 
according to a T-threshold policy. Specifically, the service rate is set to ;U; whenever the number 
of customers in the system is less than or equal to T, and equal to fi^ otherwise, where m < Hh- 
There are no switching costs. Thus, the service policy is defined by the parameters (T, fn, /j^h), 
which are known to all arriving customers. 

Arriving customers are assumed identical. They make the decision whether to join or balk upon 
arrival, in order to maximize their expected net benefit, thus they are assumed risk neutral. 
Every joining customer receives a fixed reward i? > upon service completion, and incurs a 
service cost rate C > per time unit of delay. In addition, each arriving customer has no 
information for the queue length prior to entering the system. 

Since the join decisions of individual customers affect the system delay and thus the benefit of 
all customers, the decision problem corresponds to a symmetric game. We restrict attention to 
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symmetric Nash equilibrium strategies defined as follows. 

Given that potential customers are not aware of the actual system state, an arriving customer 
has two pure strategics, cither to join the system or balk. However, for the equilibrium analysis, 
mixed strategics also have to be considered. A mixed strategy is defined by p G [0, 1], the 
probability of joining the system, where for p = 0, or 1 it reduces to a pure strategy. 

Let U (p; q) denote a tagged customer's expected net benefit from using mixed strategy p, when 
all others adopt mixed strategy q. Then, a mixed strategy q'^ is a symmetric Nash equilibrium 
strategy, if U((f,q^) > U{q,q^) for any mixed strategy q G [0,1]. The intuition is that an 
equilibrium strategy is the best response against itself, so if all customers agree to follow mixed 
strategy q^, no one can benefit from changing it. 

Under a mixed strategy q arrivals follow a Poisson process with effective arrival rate A = Aq. 
The corresponding equilibrium arrival rate is denoted hy = A ■ q^, where q"^ is a symmetric 
equilibrium strategy. In addition, the customer's expected net benefit is equal to 

U{p;q)=p[R-CW{Aq)], (1) 

where W(\) denotes the total sojourn time of a customer in the system, as a function of the 
effective arrival rate A, assuming A < /Lt^, in order to ensure stability. 

In the remainder of the paper, we refer to W{X) as the waiting time or the delay function and, 
without loss of generality, we normalize iJ-h = 'i- and C = 1. 

An alternative decision framework could be defined by assuming that all customer decisions are 
controlled by a central planner, who enforces a mixed strategy q with the objective of maximizing 
the overall expected net benefit per unit time. This corresponds to the social welfare optimization 
problem. 

Given that a common strategy q corresponds to a Poisson arrival rate A = Aq, the welfare 
function can be defined in terms of A as 

S{\) = X[R- W{X)] for A G [0, 1) (2) 

and an arrival rate A* is socially optimal if 

S(X*) = max S(X). (3) 

Ae[o,i) 

In general the equilibrium and optimal arrival rates rates do not coincide. 

In the following sections we analyze the equilibrium and social optimization problems and their 
relationship. 

In the remainder of this section we derive the expression for the delay function W{X). 

An unobservable M|M|1 queue under a T-threshold service policy and a common mixed strategy 
q for all customers corresponds to a standard birth and death process with arrival rates A„ = 
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' ~ , n S N* , where n refers to the number 
1, n>T 

of customers in the system. 

Using standard queueing analysis, we derive the following expression for the waiting time 

W{X) = ^^^^ ^ ^^^)^, (4) 

fii-X ^ 1-A 

for Ae [0,w)U(/i/,l). 

An analogous expression of H^(A) can be obtained for the case X = ^i. After simplification both 
expressions can be reduced to the following, in which the denominator is strictly positive in 

where 

5(A) = -(r-l)(l-w)A^ 
r-i 

-(1 - w) E W [(T - (j + + J - 1 - T] A^-^- + (6) 
i=i 

and 

d{X) = il-|,l)J2^^i>^'^~'+^^I■ (7) 



Note that, 1^(0) = ^ > and lim;,_,i- W{X) = +00. 
In addition, using ^ we obtain a lower bound for the waiting time: 

1 



W{X) > 



1-A' 



where the right-hand side is the expected waiting time in an M|M|1 queue with service rate 
equal to 1. 

3 Equilibrium Analysis 

In this section, we identify the equilibrium strategies under individual customer behavior. 
Using the standard methodology of equilibrium analysis in 



unobservable queueing models (see Hassin & Haviv (2003) p. 46-47), we derive from ([T]) the 
following equilibria: 

A" = if and only if W{0) = — > R. (9) 
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Note that, when ii < 1, is the unique symmetric equihbrium, because of ([s]). Similarly, 

= A if and only if W{A) < R. (10) 

In addition, a necessary and sufficient condition, for A"^ = Aq^ £ (0, 1) to be an equilibrium 
arrival rate is that 

U{q^; A^) = 0, or equivalently, WiX") = R. (11) 

Thus, the problem of identifying symmetric equilibria other than the extreme A*^ = or A, is 
equivalent to finding the solutions of the equation 

W(A) = i?, inAG (0,1), fori?> 1. (12) 

In the following we assume without loss of generality that the external arrival rate A > 1, in 
order to identify all possible equilibrium arrival rates \^ in the interval [0, 1). In the case where 
A < 1, some of these equilibria may be excluded and instead we must also consider A as a 
possible equilibrium arrival rate. 

From the properties of the delay function W{X) we derive the following lemma. 
Lemma 1 If R> then the equation W{\) = R has at least one solution in X £ (0, 1). 

Proof From the divergence oiW{X) to infinity as A — )• 1~, we derive that for any > 1, there 
exists an arrival rate Aq G (0,1) such that W{\q) > R. 

In addition, VF(0) = < R and the result follows readily from the continuity of W{X) in 
Ag[0,Ao]. 



From Lemma jlj it follows that for > ^ there exists at least one positive equilibrium arrival 
rate. On the other hand, extensive numerical analysis for different values of the parameters 
R, T and /x; has shown that there are at most three symmetric equilibria A"^ G (0, 1). 

This observation is consistent with the behavior of the delay function W{X), as demonstrated 
in Figure [T] for two typical cases of T-threshold policies (T, 1). In both plots, we observe that 
Ty(A) increases for low and high values of A, whereas for intermediate values of A, it decreases. 
Intuitively, this is happening because for small and large values of A, the system spends almost 
all time in the low or high service rate state, respectively, and the delay is approximately that 
of an M|iVf|l queue with the corresponding value of /i. 

On the other hand, for intermediate values of A, the service rate switch occurs more often. In 
this case, increasing A increases the rate of arrival to the queue, but at the same time forces the 
server to work faster and the net effect may be a decrease in the overall delay. 



Because of the non- monotone behavior of W{X), the number of roots of (12) may vary from 
to 3, depending on the values of R, T and /i;. 

For example in Figure [T]^a) , for R = 9, there are three equilibrium arrival rates, one of which 
equal to zero, while in Figure [l][^b) for R = 21, there are three strictly positive equilibria. 
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Figure 1: The expected waiting time, W{X), for {a)T = 3, fii = and (b)T = 10, 1^1 = ^ 

Note that this discussion is solely based on observation of the delay function graph for different 
numerical values. The complexity of the expressions does not allow the study of VF(A) directly. 

We instead resort to the following equivalent polynomial equation of degree T + 1, derived by 
substituting ^ in 

H{X) = -R{l-i^i)xT+^ + {l-ni){R(l-^i)+T-l)X^ 

T-l 

+(1 - fii) ^ fsj-'-' [- V + {R + j- 1)^ - (j + 1)] A^' (13) 

.T-2/ OD..2 , /D I n\.. n\\ , ..T-1, 



-\-2R^if + {R + 2)fxi - 2)A + /i/ -'{Rfil - 1) = 0. 



In general, the roots of ( 13 ) cannot be analytically expressed as a function of the parameters 
T, and R. Furthermore, the number of roots and thus of equilibria can be as high as T + 1. 
However we apply analytic techniques to bound the number of roots. 

Specifically, we will make use of the following result in analysis, referred to in the literature as 
Budan's Rule. 



Theorem 1 (Budan's Rule, Wilj (1962) p. 94) 



The number of zeros of a polynomial equation 

f{x) = ao + aix + a^x^ + • • • + a„x"' 

in (a, 6) is either equal to V{a) — V{b) or less by an even number, where V{x) is the number of 
variations of sign in the sequence (/(x), /'(x), • • • f^'^\x)). 
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In our case, let V^(A) be the number of sign variations in the sequence 

{H{X),H'{X), ■■■ , hC^+^^X)). Based on this theorem we can show the following result. 

Proposition 1 For any R> 1, 

i. V{0) < 3 

ii. The polynomial equation H{X) = has at most three roots in X & (0, 1). 

Proof i. By definition, V{0) is the number of variations of sign in the sequence 

{H{0),H'{0),...,H^''\0),...,H^^+^\0)), where H^'^^O) = nlrjn forra = 0, . . . , T + 1 and 
denotes the coefficient of A" in polynomial H{X). 

Since R> 1 and /x; G (0, 1), we obtain the following. 

First, 

rjT+i = -R{1 - w) < 0, therefore H^^+'^\o) = (T + l)!r/r+i < 0. (14) 

Also, 

r/T = (1 - - w) + ^ - 1) > 0> and thus H^'^\o) = T\r]T > 0. (15) 

In order to derive the sign of coefficients rjj for j = 2, . . . , T — 1, we let 

/(j) = -R^^f + {R- l)w - 1 - (1 - fii)j (16) 

and rewrite H^^^ (0) as 

ij(i)(0)=j!(i-^,)^f-i-^/(j). (17) 

Since f{j) is decreasing in j, there exists at most one sign variation in /(j) for j G {2 . . .T — 1}. 
Thus, there exists jo G {2 . . . T}, such that for any j = 2, . . . ,T, f{j) > if j < jo and /(j) < 
if j ^ Jo- In the following sign analysis of H^^\0), will be considered as positive. We consider 
three cases for jo^ 

1. If jo = 2, then i?(^)(0) < for any j G {2, . . . , T - 1}. 

2. If jo = T, then i?(^)(0) > for any j G {2, . . . , T - 1}. 

3. If jo e {3 . . . , r - 1}, then H^^\0) > for j < jo and i?(^)(0) < for j > jo. 
For each of these, there are four subcases depending on the signs of H'{0) and H{0): 

a. H'{0) > and H{0) > 0. 

b. H'{0) > and H{0) < 0. 

c. H'iQ) < and H{0) > 0. 
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Table 1: Signs of H^^\o) for j = 0, . . . , T + 1 and the value of 1^(0). 

d. H'{0) < and H{0) < 0. 

In Table [l] we summarize the sign analysis of H^^\0), for j = 0, . . . ,T + 1, and the value of 
V{0) for each one combination. 

It follows that V{0) < 3 is always true, except for two situations where subcase b holds. 
Thus to prove the Proposition, it suffices to show that subcase b cannot be true. 



Suppose that H'{0) > and H{0) < 0. From ([13]), we obtain that 

-2Rfi^ + {R + 2)fii - 2 > and Rfii - 1< 0^ 

However, 

-2RiJ,f + {R + 2)w - 2 = {Rfii - 1) - {2Rfif + 1 - < Rf^i - 1, 
which is a contradiction. Thus subcase b is excluded and 1^(0) < 3. 

ii. Since V{1) > 0, we obtain that V{0) — V{1) < 3, thus the result follows readily from Theorem 

m ■ 

We can further observe from the Proof of Proposition [T| that if subcase d holds, then V{0) < 2, 
thus, the upper bound on the number of roots of H{X) is reduced by one. 

In the next Corollary we provide sufficient condition for this sharper bound to hold. 
Corollary 1 If 1 < R < then H{X) has at most two roots in (0, 1). 

Proof If 1 < i? < ^, it follows that % = nf~^{RfJ^i - 1) < and rji = nJ-'^{-2Riif + {R + 
2)ni - 2) < 0. Thus, subcase d holds and ^(0) = 2. I 
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From Corollary [T] and Proposition [T] it follows that the equation H{\) = has at most three 
roots in (0, 1), for R'> jj^^. 

In the following Theorem we summarize the equilibrium analysis of our model. 



Theorem 2 For A > 1 ; 

i. If R < 1, the unique equilibrium arrival rate is X'^ = 0. 

a. // 1 < ii < then A"^ = and in addition there may exist at most two positive equilibria. 
Hi. If R > then there exist at least one and at most three positive equilibria. 

The existence of more than one symmetric equilibria is due to the non-monotone behavior of 
the delay function W{X), as discussed previously. 

Also, it is worth noting that when multiple equilibria exist, then some of them are stable, in the 
sense that a small perturbation of A will not affect system convergence to the equilibrium rate, 
while others are not. 

For example, in Figure [l][a) , there exist three equilibrium arrival rates, of which and A| are 
stable. On the other hand, Af is unstable, because a small increase in A decreases the expected 
waiting time and more customers are encouraged to join. This further increases the arrival rate, 
thus the arrival rate moves away from Af . Similar observations can be made for the example 
illustrated in Figure . In this case there exist three strictly positive equilibria, with A| being 
unstable, as it corresponds to the decreasing part of 1^(A). Finally, in both examples, for values 
of R greater than the minimum value of W{X), the maximum equilibrium arrival rate is always 
stable. 



4 Social Optimization 

In this section, we analyze the problem of social welfare optimization, where the decision problem 
for a central planner is to obtain a socially optimal strategy A*, which maximizes customers' 
overall expected net benefit per unit time S{X), as defined in Q. 

From ([5|, the social welfare function can be expressed as 



The proof is immediate from ([o]), (10), Lemma [T| Proposition [T] and Corollary [TJ 



where ^(A) and d{X) are defined in ^ and respectively. 




for A G [0, 1) 



(18) 
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From (18), S{X) is continuous and differentiable in (0, 1), thus, the first-order condition for the 



maximization problem is 

S'{X) = 0^ R-W{X) - XW'{X) = 0. (19) 



An analytic characterization of the optimal solution based on ( |19[ ) is not tractable because of 
the complexity of the expressions of W^(A) and W'{X). We thus resort to numerical analysis in 
order to explore the behavior the optimal arrival rate A* and its relationship to the equilibrium 
arrival rates. 

More specifically, we examine how the equilibrium and optimal arrival rates are affected by 
changing the values of parameters T, and R. Since, in general, the equilibrium arrival 
rate is not unique, in the diagrams we show the minimum and maximum equilibrium arrival 
rates, denoted as X'^^^ and A^^x respectively, and where the socially optimal arrival rate lies 
with respect to the range of individual equilibria. In addition, we examine the behavior of the 
maximum social benefit ^(A*) with respect to the same parameters. 

In the beginning, we present numerical results with respect to the service threshold T, which is 
an easily controlled operational characteristic of the system. We next proceed to the sensitivity 
analysis with respect to parameters R and /i^, for specific values of the service threshold. We 
consider the cases T = 10 and T = 3, the same as those used for the graphs of the delay function 
T^(A), in Figure [l} 

In Figure [2] we present the results of the sensitivity analysis with respect to the service threshold 
T, for Hi = ^ and i? = 25. We observe that the equilibrium and optimal arrival rates are 
decreasing in T. This is expected because higher values of the service threshold increase the 
time that the server spends in the low rate and customers decision to join leads to increased 
delays due to system congestion, discouraging more customers from joining. 

Moreover, for low and high values of T, the system behaves approximately as an M|iVf|l queue 
with service rate equal to and 1, respectively. Therefore, for such T values the equilibrium 
arrival rate is unique and the optimal arrival rate is lower than the equilibrium because of 
the negative externalities. On the other hand, for intermediate values of T there are multiple 
equilibria, as discussed in Section |3j In these cases the optimal rate is between the two extreme 
values A^jj^ and A^^x of the equilibrium. Thus, whether the externalities are positive or negative, 
and thus whether a tax or a subsidy is required to induce efficiency, is not known in advance 
but it depends on which of the equilibrium rates will materialize. Finally, we observe in Figure 
[2] that the maximum social benefit 5(A*) is decreasing in T for fixed values of R and /x;, as a 
consequence of the behavior of the optimal arrival rate with respect to T. 

Next, we proceed to numerical results with respect to parameters R and /x/, considering first the 
case of T = 10. Using the dynamic service policy (T, /x^, 1) for T = 10 and = g, we obtain 
A* and the corresponding equilibria with respect to R, which are illustrated in Figure [3j Note 
that, the equilibrium analysis for this service policy has been presented in Figure [T]^b) and, thus, 
both diagrams must be considered together, in order to explore the relationship between A* and 
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the equilibria. We see that, A* < A^^x low and high values of the reward, in which case the 
equilibrium arrival rate is unique, as showed in Figure [T]^b). On the other hand, for intermediate 
values of R, where there exist two or three equilibria, we observe that A^^j^ < A* < A^^x- 
this case, customers can impose either positive or negative externalities in equilibrium, as we 
mentioned before. 

Regarding the sensitivity of the social optimal arrival rate and the corresponding equilibria 
with respect to the low service rate for R = 20, which is presented in Figure [4j we see that 
A^in < A* < A^ax foi' lo'^ values of fii, whereas A* < A^g^^ for higher values. This happens 
because the service rate switch option is no longer beneficial for joining customers, as the low 
service rate increases to high values. Therefore, the expected waiting time becomes monotone 
increasing as fii increases, corresponding to the delay function of a typical M|M|1 queue, which 
results in the existence of a unique equilibrium strategy with rate larger than A* . 

Moreover in both figures, we observe that there exist a discontinuity point with respect to R or 
fii , which corresponds to the existence of two equal maxima for different values of the reward or 
the low service rate, respectively. This is due to the fact that the social benefit function S{X) 
can be bimodal for some values of i? or /i;. 

Considering the behavior of A* as well as both equilibria, we observe that they are increasing in 
R, which is intuitive considering the fact that customers either as a whole or acting independently 
are generally better off as the reward increases, and, thus tend to join more. This is also reflected 
in the behavior of the maximum social benefit ^(A*), which is always increasing in R, as observed 
in Figure [3} 

In contrast, regarding the behavior of the social optimal arrival rate with respect to fii, we 
observe in Figure |4] that it is slightly decreasing for small values, and, then becomes increasing, 
after a discontinuity jump. For this set of values of T, R, ni the social benefit function is 
bimodal in A, with two local maxima. Of these the lower corresponds to a policy that accepts 
a small proportion of customers and thus keeps delay low by avoiding congestion. 

The other local maximum occurs at a higher value of A, which means that more customers 
are accepted, so the server is forced to work at the high rate most of the time, thus keeping 
the delay moderate. For every value of m one of the two local maxima supersedes the other 
and determines the optimal value of A. For small values of the lower mode value is so low 
that almost no one is accepted, thus the higher mode is preferred. On the other hand as fii 
increases, the delay becomes more moderate even when the server works at low rate, which 
makes the lower mode preferred. The discontinuity point corresponds to the value of /i; where 
the two local maxima are equal. As /i/ increases above the discontinuity point, the low mode 
still persists but nevertheless more customers are accepted under the optimal policy. 

Note that regardless of the non-monotone behavior of A*, the optimal welfare value 5(A*) is 
increasing in fii, since higher values of this service rate can only improve system performance. 
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Equilibrium and Socially Optimal Points 



lUlaximum Social Benefit 




Figure 2: Equilibrium and Socially Optimal rates as a function of T for R = 25, fii = ^. 

Similar observations can be made for the case T = 3. For fJ-i = jq and varying R, we observe 
in Figure [5] that A* < A^^x R < 7 and R > 16, whereas A^j^ < A* < A^^x foi' intermediate 
values of R. Moreover, regarding the behavior of the social optimal arrival rate, A* has a 
discontinuity point in i? = 7. This can be explained by an analogous bimodality argument as in 
the previous case. In addition, the social optimal arrival rate A*, as well as the social optimal 
benefit 5(A*), are increasing in R as expected. 

We finally note that the discontinuities discussed above do not always occur. For other sets of 
values of T, R, the social welfare function may be unimodal in A, or even if it is bimodal one 
of the two modes may persist as optimal. In these cases the optimal arrival rate is continuous 
and monotone in the corresponding parameter. For example Figure [6j shows the dependence on 
m for T = 3 and R = 5, where there exists a unique equilibrium for any fii, which is continuous 
and increasing in /i^, as is also the socially optimal rate. In this case, the equilibrium is always 
greater than the socially optimal rate, whenever they take non-zero 



5 The Case T = 1 

In this section, we analyze the case where the service threshold T is set to 1 and, thus the service 
policy prescribes that the server uses the low rate as long as the queue is empty and switches 
to the high rate as soon as a customer joins the queue. 

This policy may be appropriate when there is a large difference between the two service rate 
values, and an assurance must be given to the customers that when there is at least one person 
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Figure 3: Equilibrium and Socially Optimal rates as a function of R for T = 10, 




Figure 4: Equilibrium and Socially Optimal rates as a function of /i/ for T = 10, R 
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Equilibrium and Socially Optimal Point: 
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Figure 5: Equilibrium and Socially Optimal rates as a function of R for T = 3, fii 
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Figure 6: Equilibrium and Socially Optimal rates as a function of ^u/ for T = 3, R 
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Figure 7: The expected waiting time W{X) for T = 1 and (a)/Ui < ^ or {h)fii > ^ 
waiting in the queue the service is expedited. 

From the analysis point of view the expressions of the delay function is now considerably simpler, 
permitting more complete analytical results. 

As in the general model, we first characterize the symmetric equilibrium strategies and then 
proceed to social benefit maximization. 

For T = 1, the delay function in ([s]) becomes 

WiiX) = j-^ ... ^, A G [0, 1). (20) 

(l-A)[w + A(l-/xO] 

In the following lemma we present some properties of the delay function Wi{\). The proof 
follows from simple calculus and is omitted. 

Lemma 2 

i. Wi{0) = ^ and liniA^i Wi{X) = +oo 

ii. If ^i>\, Wi{\) is increasing in X ^ (0;1)- 

Hi. If fii < 2, Wi{X) is decreasing in X £ (0, 2(i"-|^;) ) '^'^'^ ^'^ increasing in X £ ( 2(]"-^|) ' 
iv. Wi{X) is convex in X £ (0, 1). 
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The plot of Wi{X) for two representative values of fii is shown in Figure [7| 

Equilibrium Analysis For the equilibrium analysis we follow the same steps as in Section [3| 



Now, equation (12) becomes quadratic: 

^ri(A) = R{1 - fii)X^ + R{2fii - 1)A + 1 - Rfii = 0. (21) 

This equation Hi{X) = can be solved explicitly and may have either one or two roots in [0, 1) 
(the case of zero roots is excluded because of Lemma [T]) , depending on the values of R and fii . 

Performing a detailed but otherwise standard analysis of the roots, we obtain the following 
theorem on the number of symmetric equilibria. 

Theorem 3 For A > 1 the following hold. 

i. If R < 1, then is the unique equilibrium. 

a. // 1 < i? < 2 and fii < j^, then is the unique equilibrium. 

Hi. If R > 2 and < 1 — j, then is the unique equilibrium, 

iv. If R > 2 and fii = 1 — ^, then the equilibrium arrival rates are and Ag- 

V. If R> 2 and 1 — ^ < fn < j^, then the equilibrium arrival are 0, Af and A|. 

vi. If R> 1 and > j^, then Af is the unique equilibrium. 

where 

,e _ Ril-2fll) + y/R{R-A{l-f,i)) 

2R{1 - i^i) 
,e _ Ril-2fii)-^R{R-i{l-f,i)) 

(24) 

and 

(l-2w)_ 

2(1 -w) ^ ' 

In Figure [8] we present the number of symmetric equilibria in different regions of the R — fii 
plane, corresponding to the cases listed in Theorem |3| 

Social Optimization Proceeding to the social optimization problem, we let Si{\) be the social 
welfare function in the case of T = 1. Thus, 

Si{X) = X[R-Wi{X)], (26) 

In the following lemma we derive some properties of S'i(A). 
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Figure 8: Symmetric Equilibria for the Case T=l, for several values of the parameters and R 
Lemma 3 

i. If < \, then «S'i(A) is strictly concave in X £ [0, 1). 
a. ///i; = 1 — ^ < 2; then Si{X) is decreasing and concave in X € (A^, 1). 
Hi. If 1 — ^ < fii < ^, then Si{X) is decreasing and concave in X ^ (Af , 1). 

Proof The first two derivatives of 5i(A) are 

S[ {X) = R- Wi (A) - XW[ (A) (27) 
S'{{X) = -2W[{X) - XW['{X). (28) 

i. If ;U > ^, Wi{X) is increasing and convex in A G [0,1), as stated in Lemma [2J By ( p8| ), it 
follows that S'{{X) < VA G [0, 1), and the statement holds. 



ii. The expression of 5^ (A) in (27) can be rewritten as 

^i(A) 



S[{X) = - 



(l-A)(w + (l-w)A) 



XWiiX) 



(29) 



where IIi{X) is the polynomial in (21). 



Now, for /x; = 1 - f < ^, we obtain that Hi{X) > 0, VA G [0,Xf,) U (A§,1). Also, Wi{X) 



is increasing in A G (Ag, 1). By ([29]) and ([28]) we obtain that S[{X) < and ^"(A) < for 
A G (Aq, 1). Thus, S'i(A) is decreasing and concave in A G (Afj, 1). 
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iii. Similarly to ii. it can be shown that 5i(A) is decreasing and concave in A G (Af , 1). I 

In the following proposition we prove a result on the relationship between the optimal and 
equilibrium arrival rates. In this case, X'^ refers to a positive and stable equilibrium arrival rate. 

Proposition 2 For any fii G (0, 1) and R> 1 there exists an equilibrium }^ such that X* < X^ 
for any social optimal arrival rate X* G [0, 1). 

Proof In order to prove the statement of Proposition [2] we consider the cases of Lemma [3] for 
the value of /i/. 

First, assume > ^. By the concavity of the social welfare function S'i(A), as stated in Lemma 
[sj it follows that there exists a unique social optimal arrival rate A*, which maximizes Si{X). 

In addition, ii fJ-i < -j^ the unique equilibrium arrival rate is A*^ = with 5*^(0) = R — W{0) = 
R- j-^ <0- Thus, S[{0) < S[{X*) and by the monotonicity of ^^(A) we obtain that A* < 0, 
which results to A* = 0. If, on the contrary, > j^, the unique equilibrium arrival rate is 
A^ = Af with ^[(Af) < 0. Once again, by the monotonicity of <S'[(A) we prove that A* < A*^ for 
any A*. 

Next, we consider the case where fii = 1 — < |- By Lemma [sj we obtain that 5*1 (A) is 
decreasing and concave in A G (Ag, 1). Thus, A* < Aq for any A*, where Aq is the stable and 
positive equilibrium arrival rate, as stated in Proposition [3| 

Finally, for the case of 1 — ^ < fii < ^, it follows similarly that A* < Af for any optimal arrival 
rate A*, where Af is the stable positive equilibrium arrival rate. I 



6 Conclusions and Extensions 

In this paper, we considered the problem of customer equilibrium joining behavior in an un- 
observable M|M|1 queue with dynamically adjusted service rate according to a threshold type 
service policy, known to all customers. We proved that there exist multiple equilibria, three at 
most, due to the presence of both positive and negative externalities for different values of the 
effective arrival rate. For the social welfare optimization problem, we explored the relationship 
between the optimal and the equilibrium arrival rates in several numerical experiments for dif- 
ferent values of system parameters. We demonstrated that in cases where there exist multiple 
equilibria, the socially optimal point lies between the extreme equilibrium values, whereas in all 
other cases it is always less than the equilibrium arrival rate. 

This work can be extended in several directions. First, it would be of interest to determine the 
equilibrium strategies under different levels of information on system congestion or the status 
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of the server upon customer arrival. Some preliminary work has shown that the equilibrium 
analysis in these problems is significantly more complex, and non-threshold equilibria may exist. 
In terms of the form of the service control policy, one might consider an alternative where instead 
of increasing the service speed with congestion, one or more standby servers are activated. Such 
a policy is more relevant in situations where the service is provided by human workers. Other 
extensions include generally distributed service requirements and dynamic service speed, series of 
queues with different parameters and/or service policies, and systems where the specific service 
policy threshold is not announced to the customers. 
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